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Abstract 

We show that the second order traps in the control landscape for a three-level 
A-system found in our previous work Phys. Rev. Lett. 106 , 120402 (2011) are not 
local maxima: there exist directions in the space of controls in which the objective 
grows. The growth of the objective is slow — at best 4th order for weak variations of 
the control. This implies that simple gradient methods would be problematic in the 
vicinity of second order traps, where more sophisticated algorithms that exploit the 
higher order derivative information are necessary to climb up the control landscape 
efficiently. The theory is supported by a numerical investigation of the landscape in 
the vicinity of the e{t) = 0 second order trap, performed using the GRAPE and BEGS 
algorithms. 


1 Introduction 

Manipulation of atomic systems via specially tailored laser pulses is an important application 
of quantum control theory [Ilia El a 00 0019]. One of the questions of current interest is 
the nature of the control landscape that describes the value of the objective as a functional of 
the control held s{t), in particular the nature of the critical points on the landscape. For the 
objective J{e) a critical control held £ is a trap of the landscape if £ is a local but not a global 
maximum. Control landscapes for closed quantum systems were studied in mm, where 
the absence of traps was shown under some assumptions. The analysis for open quantum 
systems was performed in [T^l EE] and later was extended to a unihed analysis of control 
landscapes for open classical and quantum systems (H]. 

In this work we consider critical points for control objectives of the form 

J{e) = Tr[f/^po4'D] (1) 

for a 3-level A-system isolated from the environment. Such objectives describe a wide variety 
of quantum control phenomena, e.g., breaking a desired chemical bond, producing selective 
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atomic and molecular excitations, etc. Here po = N)(*| is the initial system state which is 
assumed to be pure, O is the target observable, and is the evolution operator describing 
the evolution of the system from the initial time t = 0 to the hnal time T > 0 under the 
action of coherent control held e(t). The evolution operator satishes the equation 

dU^ 

= -i{Ho + Ve{t))Ut, = I 

where Hq = i® system Hamiltonian and V is the operator describing 

coupling of the system to the control held. 

A control held £ is a second order trap for the objective functional J{e) if the gradient 
VJe = 0 and the Hessian = S^J/Se"^ is negative semi-dehnite but J{e) is not a global 
maximum. More generally, a control held £ is an n-th order trap (here n is an even natural 
number) if it is not a global maximum and 5J^ := J{e + 5e) — J{e) = R{6e) + 
where the functional R ^ 0, R{6e) = and R{6e) < 0. 

Various algorithms have been used to hnd optimal controls in quantum systems including 
gradient search, e.g. GRAPE [15] and its modihcations for rapidly time-varying Hamilto¬ 
nians [T6|, Krotov-type methods nninmniEoiEi], the Broyden-Fletcher-Goldfarb-Shanno 
(BGFS) algorithm and its modihcations [221 [2311231123], genetic algorithms and evolution¬ 
ary strategies [261E7], and combined approaches [2EI (29] . The analysis of the existence or 
absence of traps, including n-order traps, is important for determining proper algorithms for 
hnding optimal control helds. In the absence of traps, local (e.g., gradient) search should 
generally be able to hnd globally optimal controls (exceptions may occur if the initial control 
for a gradient-based search is chosen exactly at a saddle point, where the gradient of the ob¬ 
jective is zero). If the landscape has second order or n-order traps then, since the gradient of 
the objective at a critical point is zero and in addition, at second-order or n-order traps the 
Hessian is negative semi-dehnite, the objective in their vicinity may grow not faster than at a 
third order in the small variation 6e of the control. Therefore the search for globally optimal 
controls with simple gradient methods would be problematic in a vicinity of second-order or 
n-order traps, where more sophisticated algorithms exploiting the higher order information 
about the objective are necessary to efficiently climb up the control landscape. 

Second order traps were shown to exist for a general class of quantum systems [30|. The 
simplest example is a three-level A-system, where zero control held was shown to be a second 
order trap. In this work we continue the analysis of [30] and show that this second order 
trap is not a local maximum; there exist a direction in which the objective grows. We also 
perform a numerical study of the landscape in a vicinity of the e{t) = 0 second order trap. 

2 Three-level A-system 

The simplest example where second order traps appear is the following problem: maximizing 
the expectation of an operator O = ^j\j){j\ with A 2 > Ai > A 3 for a three-level non¬ 

degenerate A-atom which is initially in the ground state po = |1)(1| (Fig-[^- The interaction 
Hamiltonian V for A-atom satishes V 12 = 0, which is consistent with the controllability 
assumption if V 13 7 ^ 0 and V 23 7 ^ 0. Note that the pure state controllability for V-level 
systems with odd number of levels requires producing the full unitary group su{N), while for 
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Figure 1: The simplest example of a quantum system possessing a second order trap is a 
three-level A-system initially in the ground state. The control held e{t) = 0 is a second order 
trap for maximizing expectation of any target operator of the form O = •^iN)(*l with 

A 2 > Ai > A 3 . However, this held is not a trap, as shown in Theorem 


N even the symplectic group sp{N/2) alone is sufficient [211132] • The two allowed transition 
frequencies are ui = £3 — £1 and U 2 = £3 — ^ 2 ; non-degeneracy implies that ui 7 ^ a; 2 - 
Globally optimal control helds are those which steer | 1 ) completely into | 2 ) producing the 
global maximum of the objective with the objective value Jmax = A 2 . 

Without loss of generality we can set Ai = 0 and A 2 = 1 (replacing O by O' = (O — 
All)/(A 2 — Ai) and noticing that linear transformations of the target observable do not ahect 
the properties of critical points). Since A 3 < Ai = 0, we can set A 3 = —A, where A > 0. 
After these transformations the objective J takes the form 

J{e) = Pi^ 2 {^) — A >0 ( 2 ) 

where Pi^f{e) = \{f\U^\i)\‘^ is the transition probability from the state |z) to the state |/) 
(z = 1 , / = 2 , 3). The objective takes the values in the interval —A < J < 1. 

If e{t) = 0, then the system remains in the ground state and therefore both transition 
probabilities are zero, Pi_> 2 ( 0 ) = Pi_^ 3 ( 0 ) = 0. The corresponding objective value J = 0 is 
neither a global maximum nor a global minimum. 

Theorem 1 The control field e{t) = 0 is a second order trap with the objective value J = 
0 ^ Anax' 

More generally, a control e{t) = Sq is a second order trap if the initial density matrix 
and target operator have the form po = \k){k\ and O = AiN)(*l i^ i'h® basis |z) of the 
modihed Hamiltonian Hq = Hq — peo, where 1 < k < n and Ai > A 2 > ... > A„, and 
the dipole moment satishes {i\p\k) = 0 for all i < k. This important result was proved 
in |30]. However, previously it was not known if these second order traps are true traps 
(local maxima). The following theorem states that it is not the case and there exist local 
directions in which the objective increases. The analysis of the general case is equivalent to 
the case e{t) = 0 with the modihed Hamiltonian Hq, therefore only the case e{t) =0 will be 
treated in the rest of the manuscript. 

Theorem 2 The control field e{t) = 0 is not a local maximum; there exists a direction 6e 
in which the objective J{6e) grows as J ^ 
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Proof. Matrix elements determining the transition probabilities under the action of a small 
Se can be expanded in powers of 6 e as 

= y4i + y42 + A 3 + O(fe^) (3) 

(2|17^^|1) = B2 + 0{6e^) (4) 


where the terms An and Bn are of the order 0{6e"‘). Their explicit form can be derived from 
the perturbation expansion 


f/fc = I + 




dU 


dt 


2 ■ ■ 


dtnds(ti)... de(tn)Vt, ... 


n=l 
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Note that ( 3 | 14 ihi 2 |l) = 0 and thus A 2 = 0 for any 5e. Substituting eqs. ([^ and @ into 
eq. ([^ produces the following expansion for the objective around zero control held: 

= J(fe)-J( 0 ) 

= -A|Ai|2 + {\B2\^ - 2ARe(AtA3)) + 0(fe®) 


(If the diagonal elements of V are zero as is normally the case for the A-system, this implies 
that for the A-system {2\Vt^Vt2Vt^\l) = 0 and {3\Vt^Vt^Vt^Vt^\l) = 0. Therefore the term of 
hfth order on the right hand side of this equation vanishes and the remainder is of sixth 
order.) 

If Ai 7 ^ 0, then 5J = — A|Aip -|- 0{5e^) < 0 for sufficiently small 5e. The Hessian 
of the objective at £ = 0 is negative semi-dehnite and therefore £ = 0 is a second order 
trap. However, if there would exist a 5e such that Ai = 0 and B 2 7 ^ 0, then would be 
5J = |i? 2 p + 0{6e^) > 0 and e = 0 would not be a trap. 

An example of 6e for which Ai = 0 and H 2 7 ^ 0 is the following (we assume T > T' := 
271/oji). Set 6e(t) = aX[o,T'](t), where X[o,t] is the characteristic function of the segment 
[0, T], i.e. 5e{t) = a if 0 < t < T' and 5e{t) = 0 if t > T' (a > 0 is a small number). Then 


Ai 

B 2 


7^31 A 
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The quantity i ?2 7 ^ 0 if r ^ Z which is trivially satished since 0 < Ci ;2 < ti;i. This proves the 
Theorem. 

The most general conditions for 6e to increase the objective at the 4th order are 

:= f = 0 (9) 

Jo 

fti 

Se(ti) / dt 2 e 

Jo 

The condition &(a;i) = 0 means that a control held 6e which increases the objective should 
have zero amplitude at the frequency Ui of the 1 —)■ 3 transition. Such a held does not 
populate the level |3) in the hrst order of the perturbation theory (via one-photon pro¬ 
cesses). Because of the special form of the interaction Hamiltonian V, the level |3) can 
not be populated also in the second order of the perturbation theory (via two-photon pro¬ 
cesses). However, level |2) can be populated at second order in the perturbation even by 
helds which have zero amplitude at the frequency oji if ^ 2 ( 1 ^ 1 , 1 ^ 2 ) 7 ^ 0. Such a transfer 
of population increases the objective at the rate ~ Similar control pulses which are 
non-resonant but have non-zero two-photon transition probability were used for coherent 
control of multiphoton transitions |33j . 

The analysis shows that for the A-system in some directions around second order traps 
the objective increases. Such behavior was also found for a four-level system by constructing 
a second order trap where the objective increases in a direction 5e{t) = X[o, 7 r](^) |35] (Ex¬ 
ample 2). However, this increase is slow (at best it is of 4th order in 5e in our case, and 
of 3rd order in the example of [35]) and simple gradient methods may not be effective in 
escaping these critical points. Therefore more sophisticated algorithms exploiting the higher 
order information about the objective are generally necessary to climb up the landscape in 
the vicinity of second order traps. 


-‘*^"^^£(^2) ^ 0 (10) 


^2(1^1,1^2) := / dtie 




3 Numerical analysis 


In this section we consider piecewise constant controls of the form 


M 

k=l 


where X[ 4 , 4 +p(t) is the characteristic function of the interval [tk,tk+i] (i.e., ^ 

if t E and X[tk,tk+i]{'t) — 0 otherwise), = /S.t{k — 1) and At = T/M. In this 

representation the control is an M-dimensional vector C = (ci,... ,cm)- The objective is 
dehned as 

J{C) = 1:i[UtPoU^tOI where Hr = Ht(C') 

The gradient of the objective is 


VJ(C') = 


fdJ{C) dJ{C)\ 

V dci ’■■■’ dcM J 
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Here the partial derivative with respect to q has the form 


dJ{C) 

dcj 


= 2 At ■ Imf Tr 


wIvWiPoUIOUt 


where 

= UiUi.i... U^Ui, Uk = Ut = Wm 

We use GRAPE [15] and BEGS from the MATLAB Optimization Toolbox as local search 
algorithms. The GRAPE algorithm starts with a randomly generated initial control Gi, 
computes the gradient VJ(Gi), updates the control as G 2 = Gi + eVJ(Gi), where e > 0 is 
a small number, and continues the loop either until the objective reaches the value Jstop = 
1 — /err, where /err is some threshold or until some number Z/gtop of iterations is reached. 
The components of the initial control Ci are generated randomly with uniform distribution 
in the interval [—co,co] with some cq > 0. Since the second order trap is at e{t) = 0, cq can 
be viewed as measure of distance from the second order trap. 

We consider the following parameters of the A-system: 
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The hnal time in the simulations is chosen as T = 10, that is several times larger than typical 
oscillation periods in the system. First we consider the case A = 0 which corresponds to the 
standard Pi ^2 problem, where the objective is to transfer the population from the ground 
state |1) to the intermediate state |2). For this case, second order traps were not discovered 
in [30]. Figure shows that for this case it is easy to hnd, even in a small number of 
iterations, control helds that produce an objective which deviates from the global maximum 
by as little as 10 “^. Figure]^ (left) shows the distribution of the number of iterations required 
to achieve 99.999% population transfer and (right) the distribution of initial objective values. 
It is seen that despite the fact that the search generally starts from low objective values, i.e. 
the bottom of the landscape, it always reaches the top in a small number of iterations. 

Now we consider the case A > 0, with the goal to analyze how for small initial controls the 
e{t) = 0 second order trap may signihcantly slow down the search for global maxima. Recall 
that O = |2)(2| — A|3)(3|, and therefore larger values of A should have a more signihcant 
effect on the slowdown of the search. We choose A = 5 and perform the optimization 
for Cq = 0.1, 0.2, 0.3,... 1. For each choice of cq, L = 100 runs of the GRAPE algorithm 
were performed with components of the initial controls generated randomly in the interval 
[—Co,Co]. Other parameters were chosen as follows: //stop = 1000 for the maximum allowed 
number of iterations, /err = 0.1 for the allowed deviation from the global maximum of the 
objective, e = 0.1 for the iteration size, T = 10 for the hnal time, and M = 200 for the 
number of components in each control. 

For each cq we determine the number of unsuccessful attempts Wau (among L runs) when 
the algorithm fails to reach the objective value 1 — Arr in less than Z/gtop iterations. We also 
determine the mean number of iterations required to reach the objective value 1 — /err in 
the successful L — Wau runs. These data are plotted in Fig. For cq = 0.1 and cq = 0.2 
we hnd that Waii = L, showing that all runs of the algorithm fail if the amplitudes Ci of 


6 





1 


0,9 - / 

0,8 - / 

0,7 - / 

0,6 - / 

0,5 - / 

0,4 - /r\ 

0,3 - / / \ - - 

/ N, Objective value 

- Gradient norm 

0,1 - 

0 -1-1-1 l~ I - 1- 

0 50 100 150 200 250 300 350 

Number of iterations 

Figure 2: (Color online) A typical example of the behavior of the objective and the norm 
of the gradient vs number of iterations for maximizing the Pi ^2 transition probability for 
a three-level A-system. The parameters are: M = 200, cq = 1, e = 0.1, Arr = 10“^. The 
objective value 0.99999 is reached in 323 iterations. 
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Gradient norm 



Figure 3: (Color online) L = 1000 initial controls were randomly generated to produce these 
plots for maximizing Pi ^2 in a three-level A-system (M = 200, cq = 1, e = 0.1, Arr = 10“®). 
Left histogram represents the distribution of the number of iterations required to reach the 
objective value J = 1 —Arr = 0.99999 (minimum number of iterations is 165, maximum 1400, 
mean 388, and the standard deviation a = 125). Right histogram represents the distribution 
of the initial objective values. In each histogram 25 intervals were used. 
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the initial control satisfy q < 0.2 (i = 1,..., M). The number of failed runs decreases with 
increase of cq and becomes close to zero when cq = 1. Starting from cq = 0.3, the mean 
number of iterations required to reach the desired objective value decreases linearly. We also 
observe that if the limiting number of iterations K^top is increased then some runs will be 
successful even for small cq. However, in practice there always exist limits on the number of 
possible iterations and therefore if a large number of iterations is required to reach a desired 
objective value, for practical purposes this may look like a trap. Another comment is that 
the number of iterations might be dependent on the details of the algorithm. For example, 
using an adaptive step size may improve performance of the gradient search at points with 
small gradient. For comparison we use the BFGS method. The number of fails for every cq 
is less than for GRAPE, particularly for small cq, as plotted by the dashed line in Fig. 
The decrease in the efficiency of the linear gradient search was also observed for quantum 
systems which have forbidden transitions between distant energy levels [M]. The three-level 
A-system has a forbidden 1 —)• 2 transition and therefore is within this class. Our work 
however studies a different dependence of the efficiency — on cq, which is effectively the 
distance of the initial control from the second order trap. 


Conclusions 

This work shows that constant controls, which are second order traps in the control landscape 
for a three-level A-system, are not local maxima: there exists directions around these controls 
in which the objective increases at 4th order. A numerical investigation shows that indeed 
the search with simple gradient methods becomes slow in a sufficiently small neighborhood 
of e{t) = 0. These results suggest that in the vicinity of second order traps, simple gradient 
algorithms may not be sufficient, and more sophisticated algorithms that exploit higher order 
derivative information may be necessary. 
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